The Moz Q&A Forum

    • Forum
    • Questions
    • Users
    • Ask the Community

    Welcome to the Q&A Forum

    Browse the forum for helpful insights and fresh discussions about all things SEO.

    1. SEO and Digital Marketing Forum
    2. Categories
    3. SEO Tactics
    4. How can I make a list of all URLs indexed by Google?

    Moz Q&A is closed.

    After more than 13 years, and tens of thousands of questions, Moz Q&A closed on 12th December 2024. Whilst we’re not completely removing the content - many posts will still be possible to view - we have locked both new posts and new replies. More details here.

    How can I make a list of all URLs indexed by Google?

    SEO Tactics
    redirectindexed urlsgoogle url indexgoogle broken links
    7 6 4.9k
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as question
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • aplusnetsolutions
      aplusnetsolutions last edited by

      I have a large site with over 6000 pages indexed but only 600 actual pages and need to clean up with 301 redirects. Haven't had this need since Google stopped displaying the url's in the results.

      BlueprintMarketing SHIJOTACS 3 Replies Last reply Reply Quote 0
      • Kaushalwpandas
        Kaushalwpandas last edited by

        very depressed of being not indexing URL - https://www.wrightleatherworks.com/collections/gun-holsters-for-women please someone help

        1 Reply Last reply Reply Quote 0
        • Natalie305
          Natalie305 last edited by

          Open the sitemap in a text editor or XML viewer. Look at the <loc> tags in the sitemap file. These tags contain the URL of each page on the website. You can copy the URLs from the <loc> tags into a spreadsheet or text document.

          1 Reply Last reply Reply Quote 1
          • Luna204
            Luna204 last edited by

            Open the sitemap in a text editor or XML viewer. Look at the <loc> tags in the sitemap file. These tags contain the URL of each page on the website. You can copy the URLs from the <loc> tags into a spreadsheet or text document.

            1 Reply Last reply Reply Quote 0
            • SHIJOTACS
              SHIJOTACS @aplusnetsolutions last edited by

              @aplusnetsolutions create a seperate sitemap for not indexed pages and upload to google web master tools. i had a website had same issues. Also remember it will take some time also

              1 Reply Last reply Reply Quote 0
              • BlueprintMarketing
                BlueprintMarketing @aplusnetsolutions last edited by

                @aplusnetsolutions
                Make sure all these things are selected in screaming frog and crawl analysis selected

                1 Reply Last reply Reply Quote 1
                • BlueprintMarketing
                  BlueprintMarketing @aplusnetsolutions last edited by

                  @aplusnetsolutions

                  Going to Google search console it will tell you how many inches are inside Google search index there are a few other ways to do this if you want

                  #1
                  By far the easiest is to going to search console and select coverage and all known pages
                  alt text

                  number 2

                  For the quick and dirty method, simply perform a simple site search in your Google search bar with “site:yourdomain.com”

                  #3

                  You can crawl your site using screaming frog (it will 500 pages for free but every SEO should have it) use it to index your site and connect it to Google search console API as well as Google analytics and you will have a easy-to-read CSV export of your index and non-index pages
                  more on how this is done

                  ![ you can see the non-indexable URLs on the the right click that](77e61d47-2172-491c-8070-9a6cd5905fff-image.png image url)

                  video https://youtu.be/iYeXSdUt_hg

                  #4
                  or indexer site with any thing that can export a CSV download the CSV uploaded here and it will tell you which pages are in Google's index
                  https://www.rankwatch.com/free-tools/google-index-checker

                  https://searchengineland.com/check-urls-indexed-without-upsetting-google-follow-267472

                  https://seo.co/google-index/

                  1 Reply Last reply Reply Quote 0
                  • 1 / 1
                  • First post
                    Last post

                  Got a burning SEO question?

                  Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.


                  Start my free trial


                  Explore more categories

                  • Moz Tools

                    Chat with the community about the Moz tools.

                    Getting Started
                    Moz Pro
                    Moz Local
                    Moz Bar
                    API
                    What's New

                  • SEO Tactics

                    Discuss the SEO process with fellow marketers

                    Content Development
                    Competitive Research
                    Keyword Research
                    Link Building
                    On-Page Optimization
                    Technical SEO
                    Reporting & Analytics
                    Intermediate & Advanced SEO
                    Image & Video Optimization
                    International SEO
                    Local SEO

                  • Community

                    Discuss industry events, jobs, and news!

                    Moz Blog
                    Moz News
                    Industry News
                    Jobs and Opportunities
                    SEO Learn Center
                    Whiteboard Friday

                  • Digital Marketing

                    Chat about tactics outside of SEO

                    Affiliate Marketing
                    Branding
                    Conversion Rate Optimization
                    Web Design
                    Paid Search Marketing
                    Social Media

                  • Research & Trends

                    Dive into research and trends in the search industry.

                    SERP Trends
                    Search Behavior
                    Algorithm Updates
                    White Hat / Black Hat SEO
                    Other SEO Tools

                  • Support

                    Connect on product support and feature requests.

                    Product Support
                    Feature Requests
                    Participate in User Research

                  • See all categories

                  • Google not listing website correctly
                    Roycd
                    Roycd
                    0
                    10
                    723

                  • Google search console 380,000 spam backlinks
                    xurupita
                    xurupita
                    0
                    6
                    514

                  • URL with .html or not
                    Sert_Sibiu
                    Sert_Sibiu
                    0
                    9
                    1.9k

                  • Using NoIndex Tag instead of 410 Gone Code on Discontinued products?
                    BakeryTech
                    BakeryTech
                    0
                    3
                    1.4k

                  • slug Link redirect to subdomain?
                    Leviiii
                    Leviiii
                    0
                    4
                    2.1k

                  • Site showing up in Google search results for irrelevant keywords
                    Tunnel7
                    Tunnel7
                    0
                    6
                    3.5k

                  • Multiple URLs from One Domain on Page 1
                    BeKonstructive
                    BeKonstructive
                    0
                    3
                    2.2k

                  • Google Not Indexing Pages (Wordpress)
                    Hasanovic
                    Hasanovic
                    1
                    10
                    4.4k

                  Get started with Moz Pro!

                  Unlock the power of advanced SEO tools and data-driven insights.

                  Start my free trial
                  Products
                  • Moz Pro
                  • Moz Local
                  • Moz API
                  • Moz Data
                  • STAT
                  • Product Updates
                  Moz Solutions
                  • SMB Solutions
                  • Agency Solutions
                  • Enterprise Solutions
                  • Digital Marketers
                  Free SEO Tools
                  • Domain Authority Checker
                  • Link Explorer
                  • Keyword Explorer
                  • Competitive Research
                  • Brand Authority Checker
                  • Local Citation Checker
                  • MozBar Extension
                  • MozCast
                  Resources
                  • Blog
                  • SEO Learning Center
                  • Help Hub
                  • Beginner's Guide to SEO
                  • How-to Guides
                  • Moz Academy
                  • API Docs
                  About Moz
                  • About
                  • Team
                  • Careers
                  • Contact
                  Why Moz
                  • Case Studies
                  • Testimonials
                  Get Involved
                  • Become an Affiliate
                  • MozCon
                  • Webinars
                  • Practical Marketer Series
                  • MozPod
                  Connect with us

                  Contact the Help team

                  Join our newsletter
                  Moz logo
                  © 2021 - 2026 SEOMoz, Inc., a Ziff Davis company. All rights reserved. Moz is a registered trademark of SEOMoz, Inc.
                  • Accessibility
                  • Terms of Use
                  • Privacy

                  Looks like your connection to Moz was lost, please wait while we try to reconnect.